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IMPROVEMENTS TO DIGITAL CAMERAS 

This invention relates to the field of digital cameras. It in particular, but 
not exclusively, relates to digital cameras configured to capture an 
5 electronic image of a document which is largely free from the effects of 
non-uniform illumination of the document. 

The most widely used devices for the capture of electronic images of 
documents are flat-bed and sheet fed scanners. In the flat-bed scanner a 
10 document is placed on a platten. A light source and a detector are moved 
across the document to capture an image. In the sheet fed scanner the 
light source and the detector are fixed in place and the document is moved 
relative to the detector by a sheet feeder. 

15 In both the flat-bed and sheet feed scanners the light source and detector 
are supported in close proximity to the document. This allows the amount 
of light incident upon the document and which is diffusely reflected to the 
detector to be tightly controlled. As such, high quality images can be 
obtained. 

20 

An alternative device which can be used to capture an electronic image of 
a document is the digital camera. This typically comprises a detector and 
a light source which are positioned at a distance above a document to be 
captured. To avoid specularities in the captured image it is usual to 
25 position the light source at an oblique angle to the document so that any 
speculary reflected light is outside of the field of view of the detector. 
Also, by using a bright light such as a flash and a closely bracketed 
exposure time the effects of ambient light can be minimised. 

30 A problem with the use of a flash light, and in particular an obliquely 
arranged light, is that the intensity profile of the illumination of the 
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final image in which the effects of non-uniformity have been substantially 
removed. 

The invention thus provides for processing of a captured image with 
5 calibration information to remove the effects of uneven lighting from a 
final image. 

The calibration information may comprise a plurality of individual 
calibration values corresponding to respective data values in the captured 
10 image. 

Each calibration value may correspond to the data value produced by the 
respective pixel in the detector when capturing an image of a 
predetermined test sample. In this case, the processor may divide each 
15 data value in a captured image by the corresponding calibration value. 
The result of the division may subsequently be multiplied by an amount 
dependent upon the known colour and reflectance of the test sample. 

Alternatively, the calibration values may comprise scaling values, each 
20 scaling value dependent upon the data value obtained from a pixel when 
capturing the test image. In this case, the processor may multiply each 
data value by its corresponding calibration value to produce the required 
value for the final image. 

25 The captured image may comprise one data value for each detection 
element in the detector. The memory may then conveniently store a 
calibration value for each of the data values in the captured image. 

Alternatively, the memory may store calibration values for a selection of 
30 the detection elements and the processing means may be configured to 
interpolate between two or more of the stored calibration values to 
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determine the calibration value for an individual data value in a captured 
image. This is advantageous as it reduces the amount of memory 
required. The results are typically satisfactory for document capture as 
the illumination profile will typically only change gradually across the 
5 document. 

For example, where the detection elements are arranged in a grid the 
memory may store calibration values for every alternate detection element 
in the grid and interpolate the values for the intermediate detection 
10 elements by averaging the stored calibration values of the adjacent 
elements. 

The detector may comprise a mono-chromatic detector comprising a 
plurality of detection elements which are sensitive to the same range of 
15 light wavelengths. In this case the calibration values a will represent the 
sensitivity of the detection elements to that range of wavelengths. 

In a refinement, the detector may comprise a colour detector comprising 
at least two sets of detection elements arranged in a predetermined 
20 pattern, a first set of detection elements having a first spectral sensitivity 
and the second set having a second, different, spectral sensitivity. 

Where a colour detector is provided the read-out means may capture an 
image of the document which comprises two sets of data values, a first set 
25 comprising a plurality of data values obtained from the first detection 
elements and the second set comprising a plurality of data values obtained 
from the second set of detection elements. 

The memory may store two subsets of calibration information, with one 
30 sub-set for each of the two parts of the captured image. 
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In a most convenient arrangement three sets of detection elements are 
provided, each having a different spectral response. The three sets may be 
predominantly sensitive to red, green and blue light. 

5 The three sets of colour sensitive pixels may be arranged in an RGB 
Bayer pattern or any other known pattern known as a colour mosaic. 

Preferably, the data values defining the first, second and third sub-images 
are processed with the calibration information prior to colour plane 
10 construction of the final image. 

Performing the calibration on the raw colour data prior to colour plane 
construction is advantageous as it will require only one third of the 
calculations. It will also allow imbalance in illumination across the 
15 different colour pixels to be performed. 

The image capture apparatus may include a low pass filter and the 
processor may pass the calibration information through the filter. The low 
pass filter may be either a frequency domain or spatial domain filter. 
20 Such a filter is advantageous in reducing noise in the final image. 

The apparatus may include a test document of known colour, and in which 
the read-out circuit is configured to capture a test image corresponding to 
the test document, the processing means being configured to determined 
25 the calibration information from the test image and store the calibration 
information in the memory. 

The test document may comprise a image having a uniform reflectivity 
and colour. This makes the calibration process easier. The image may be 
30 printed onto a sheet of paper or card or the like. In one arrangement the 
test document may comprise a blank sheet of plain (white) A4 paper. 
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Of course, other test documents may be used provided that the processor 
has a knowledge of the pattern on the test document. 

5 The calibration profile may be determined once during use of the camera 
in response to a user command. This may be performed in the factory 
before the camera is sold. 



Alternatively, the profile may be calculated many times at the demand of 
□ 10 a camera user. This allows gradual changes in profile to be compensated. 

In a further alternative, the processing means may include averaging 
Ci means which monitors the average data value for a detection element in a 

number of captured images, and generates calibration values from the 
15 average values. This takes advantage of the assumption that the average 

fU 

N: intensity and colour of any point in a set of captured images will be the 

same as the average for all the remaining points over time. It also 
^ eliminates the need for a test document to be provided. 



20 This may be combined with a set of calibration information initially 
obtained using a test image. The results of the averaging may be used to 
modify the stoud calibration information over time. 



Whilst it is possible to provide an illumination means which comprises a 
25 single light source, the apparatus may optionally include a second light 
source. In this case, the apparatus may be adapted to capture a first image 
when the document is illuminated by the first light source, capture a 
second image when the document is illuminated by the second light 
source, and combine the two images to produce the final image. 
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Preferably, each of the two captured images may be combined with stored 
calibration information prior to combining the two images. This is 
especially advantageous as each light source will produce a different 
illumination profile across the document. 

5 

Where two light sources are used, two sets of calibration information may 
be stored in the memory. A first set of information may be used for the 
first image with the second set being used for the second image. Each set 
may comprise a number of sub-sets of information when a colour detector 
10 is provided. 

The read-out circuit may be combined with the detector as part of the 
camera. The processing means may also form a part of the camera or may 
be provided remotely. It may, for example, comprise a computer 
15 connected to the camera by a suitable data link such as a cable. 

A number of different types of detector are envisaged within the scope of 
the invention. An example of a suitable detector is the CCD array. 

20 It will be appreciated that the document may be divided into several small 
pieces with each piece being captured in turn by the detector to build up a 
complete image of the document. This can be achieved by providing 
suitable optics which scan the document across the detector or providing 
and actuator which physically moves the detector. Such arrangements fall 

25 within the scope of the present invention. In each case, the calibration 
information that is applied to the data values captured by the detector will 
vary depending upon which portion of the document is being captured at 
any one time. 

30 The or each light source of the illumination means may form a part of the 
camera or may be mounted remotely from the camera. For example, a 
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stand may be provided which supports the camera and the illumination 
means may be supported by the stand. It may be built into the stand if 
required. 

5 In accordance with a second aspect the invention provides a method of 
capturing an image of a document, the method comprising the steps of: 
providing a test document to be captured; 

illuminating the test document with light from an illumination means; 
providing a detector having a plurality of detection elements, 
10 capturing an image of the illuminated test document using the detector, 
the captured image comprising a plurality of data values; 
and processing the data values in the captured image in combination with 
calibration information indicative of the illumination profile of the 
illumination means across the document to produce a final image. 

15 

In accordance with a third aspect, the invention provides a data carrier 
which includes a computer program which when running on a computer 
connected to a camera provides apparatus according to the first aspect of 
the invention or operates the apparatus in accordance with the method of 
20 the second aspect of the invention. 

There will now be described, by way of example only, one embodiment 
of the present invention with reference to the accompanying drawings of 
which: 

25 

Figure 1 is a schematic of a digital camera apparatus in accordance with a 
first aspect of the invention; 

Figure 2(a) illustrates a calibration image capture from a calibration 
30 target which is used to determine a suitable calibration profile for the 
apparatus of Figure 1 ; 
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Figure 2(b) illustrates the effects of the intensity profile on the raw 
captured image of a document using the apparatus of figure 1 ; 

5 Figure 2(c) illustrates a final image produced using the camera of Figure 
1 in which the intensity profile has been removed; and 

Figure 3 is an illustration of a typical arrangement of colour pixels in the 
detector array of the digital camera of Figure 1 of the accompanying 
10 drawings. 

As illustrated in Figure 1 of the accompanying drawings, a digital image 
capture apparatus in accordance with the invention comprises a digital 
camera 101 placed directly above a document 102. The camera is 
15 maintained in fixed position by a stand (not shown) vertically above the 
document, which is placed on a flat surface 104 such as an area of 
deskspace. 

The digital camera comprises a lens 105 located on a lower face of the 
20 camera 101. Also positioned on the lower face of the camera-to one side 
of the lens, is a light source 106. The light source emits a controlled 
beam of light downwards towards the document 102 which is then 
reflected upwards from the document. The field of view of the lens 105 
and the angle at which the light is emitted ensures that any specularly 
25 reflected light from the light source 106 is not collected by the lens. 

The digital camera 101 further includes a detector 107 located behind the 
lens 105. This comprises an array of image collecting detection elements ( 
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or nodes) which each produce an output signal when illuminated. The 
magnitude of the output from each element defines a data value in a 
captured image. 

5 The digital camera 101 further includes a read-out circuit 108 which is 
adapted to produce a captured image corresponding to the output from 
detection elements in the detector array. 

The camera read-out circuit 108 is connected to a computer 109 by an 
10 appropriate electrical cable 110. This cable 110 carries the captured 
image data to the remote computer 109 where it is stored in an area of 
memory 111. The cable 110 also carries control signals from the 
computer 109 to the camera. These signals turn the light source ON or 
OFF as required, and also control the read-out circuit to initiate the 
15 capture of an image. 

The computer 109 includes a processor 112, a display 113 and an input 
means 114 such as a keyboard or mouse. The processor 112 is connected 
to the input means, the display and the memory by a communications bus 
20 (not shown) in a known manner and also to the memory 111 in which the 
captured image is stored. 

In use of the apparatus, the document 102 is positioned below the camera 
101. Operation is initiated by a user pressing a button on the keyboard or 
25 mouse 114. Upon receipt of the user input the processor 112 issues a 
sequence of control signals to the digital camera 101 along the cable 110 
to acquire the captured image. 
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Because the light source is at an oblique angle to the document it does not 
produce an even illumination. In order to compensate for this effect the 
memory includes a set of calibration information which is applied to the 
5 raw data of the captured image. 

The calibration data comprises an array of scaling values which are 
predetermined for the camera. For each element of the detector a unique 
value is stored in the memory. After scaling, the effects of the uneven 
illumination are significantly removed from the captured data. 

10 

To produce the calibration data that is stored in the memory a test image 
of a test document of uniform white colour is captured. If the illumination 
from the light source was perfect, each node of the detector would 
produce the same output value. However, since the intensity of the light 
15 source is uneven across the document the detection elements will produce 
different output values. An example of a white test document and the 
effect 201 of uneven illumination is provided in Figure 2(a) of the 
accompanying drawings, whilst Figure 2(b) is an example of an actual 
document 202 captured by the camera under the uneven illumination. 

20 

Once the test image has been obtained, the information contained therein 
can be used to correct the uneven illumination of the captured document. 
The processor stores from the test image the measured data value for each 
detection element of the detector. These values define calibration 
25 information which can be applied to the data values generated by the 
detection elements in any captured image. 

Assuming that each of the stored data values from the test image are 
denoted W,j ( where I and j are the horizontal and vertical positions of the 
30 data value in the captured image, and that the data values in an actual 
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captured image are denoted D, s , the values C ;j to be allocated to the final 
image is determined by: 



5 

Where the value WHITE is the light level (intensity) required appropriate 
for the number of bits used to represent each intensity value (i.e. 255 for 
8 bits). 

10 To reduce the amount of noise introduced as a result of this processing 
the test image data values may be passed through a low pass filter. 

An alternative, more efficient computation can be achieved by replacing 
the division operation by the stored data value W i} with a division by a 
15 power of 2 (which can be achieved by a shift right of N bits) . In order to 
do this the processor may perform the following modified calculation: 



where G l} are computed gain values determined from the test image data. 

These gain values are stored in array in the memory and provide all the 
25 necessary calibration information. The raw test image data values then no 
longer need to be stored. Of course, the raw test data values are required 
to determine the gain values and so may need to be stored in temporary 
memory after capture. 




C, = (D s xG, +(l « N-l))» N 
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and 



WHITE x(l«N) 
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The more bits of precision given to the gain values the more accurate the 
division. Generally, gain values of 16 bit length are sufficient for 8 bit 
data values. The addition of the extra (1< < (N-l)) has the effect of 
rounding rather than truncating the final value. 

5 

To reduce the memory burden, the apparatus may only store gain values 
at a lower resolution than the resolution of the detector itself. For 
example, a gain value may be stored only for every second or third or 
fourth pixel in the array. To determine the appropriate gain value for a 
10 pixel the processing means interpolates between the stored values nearest 
to that pixel. This is sufficiently accurate for most applications in which 
the intensity profile varies only slowly across the document. 

In each case, a final image is produced which is substantially free of the 
15 effects of uneven illumination. An example 203 of a final image produced 
for the captured document of Figure 2(b) is given in Figure 2(c) of the 
accompanying drawings. 

Whilst the calibration information described hereinbefore is suitable for 
20 use with a monochromatic detector the apparatus may be provided with a 
colour detector. Figure 3 of the accompanying drawings is an example of 
the arrangement 301 of detection elements in an appropriate colour 
detector. The detector differs from a monochrome device in that three 
different colour filters (in this example red, green and blue filters) are 
25 laid down over the detection elements in a Bayer type pattern. Of course, 
other patterns are suitable, and other filters may be used. 

The filters divide the detection elements into three groups sensitive to the 
red, green and blue regions of the spectrum. Each group of elements 
30 produces a respective sub-image. These sub-images may be combined in 
any one of a number of known ways to produce a final coloured image. 
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In a similar way to the processing applied to the monochrome elements, 
each of the data values forming a sub-image is processed with a 
corresponding set of calibration information prior to production of the 
final coloured image. This approach is preferred as it requires only one 
third of the processing that would be needed after the construction of the 
final coloured image. 

It will be appreciated that the calibration information need only be 
determined once for a given apparatus. Indeed, in most cases it is 
envisaged that a test image will be captured and the gain values 
determined during manufacture or upon first using the device. 

As it is expected that the required calibration information stored in an 
individual apparatus will be predominantly determined by the type of light 
source used and the geometry of the camera, this data may even be 
produced in a lab using a test apparatus and the information simply 
written into memory in the camera before use. 

However, it may be advantageous to perform the determination of the 
calibration information at various times during the life of the camera. 
This allows for changes in camera performance over time to be taken into 
account. 

To allow the user to calibrate the apparatus a test image may be provided 
with the camera. This may simply comprise a sheet of white card of 
uniform colour and reflectance. 

An alternative approach for producing the calibration information may 
also be provided which does not require a test image. In this arrangement, 
the average data value produced by each pixel over time may be stored in 
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the memory. It is reasonable to expect that over an extended period the 
average value output from each pixel will be the same. Thus, keeping a 
record of the average value for each pixel provides sufficient calibration 
information to permit correction of uneven illumination to be achieved. 



